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•  Joint  Explosive  Ordnance  Disposal 
(JEOD)  Decision  Support  System  (DSS) 

-  Challenges 

-  Overview 

•  DARPA  -  Semantic  Web  Research 

-  Dynamic  Job  Aid  System  (DJAS) 

-  Technology  Behind  the  Scenes 

•  JEOD  Knowledge  Transfer  Operational 
Demonstration  (KTOD)  Advanced 
Concept  Technology  Demonstration 
(ACTD) 

-  Technology  Overview 

-  Content  Authoring  Tool  (CAT) 

-  Reference  Assistant  Tool  (RAT) 

•  Summary 

•  Questions 
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Save  Warfighter  Lives 

-  EOD  warfighters  exposed  to 
increasingly  sophisticated  terrorist 
improvised  explosive  devices  (lEDs) 

-  Inadequate  Information  Dissemination 

Enabie  near  reai-time  dissemination 
of  criticai  content  to  mobiie  users 

-  Deploy  network  to  enable  mobile 
users  access  to  semantic  web 

-  Near  real-time  Tactics,  Techniques 
&  Procedures  (TTP)  generation  and 
dissemination 

Reduce  Cost  for  Procedurai 
instructionai  Content 

-  Provide  a  system  to  author  and 
publish  contextualized  content  to 
multiple  form  factors  - 
“author  once  publish  many” 
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lED  Fatalities  By  Month 


Source:  http://icasualties.org/oif/IED.aspx 
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Context:  JEOD  Decision  Support  System 
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Gateway 


US  Northern  Command 
SF  FBI  Field  Office  O 


lAVEOI 


Gateway  6 


Gateway  1 


Gateway 


I  Marine  Det 


Gateway  2 


Gateway  5 


Gateway  7 


(§)  JEOD  Core  Site 
JEODNET  Gateway 
Q  EOD  Detachment 
^  Operational  Commander 
(§)  Coalition  Partner  Detachment 

Civilian  or  Non-DoD  Government  Entity 
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JEOD  DSS  Context 


•  Joint  Explosive  Ordnance  Disposal  (JEOD)  Advanced  Concept 
Technology  Demonstration  (ACTD)  is  placing  new  tools  in  the 
hands  of  EOD  techs  facing  lED  threats. 

•  JEOD  techs  will  use  the  Decision  Support  System  (DSS)  to  access 
“just-in-time”  Job  Aids. 

•  Job  Aids  help  them  learn/recall  how  to  perform  their  mission. 

•  DRC  developed  tools  which  leverage  Semantic  Web  technology  to: 

-  Reduce  development  costs  of  authoring  Job  Aids  by  dynamically 
composing  Job  Aids  from  procedural  knowledge  bases  on  the  fly. 

-  Enable  “just-in-time”  training  with  tailored  instructions  based  on 
current  conditions 

(e.g.,  user  roles,  weather,  location,  mission  phase,  etc.). 


Page  7  of  44 


DYNAMICS 
DR^  RESEARCH 

CORPORATION 


JEOD  DSS  Overview 


MORSS 

us  Naval  Academy 
Annapolis.  Maryland 

Jane  12-13-14  2007 


'nuc«9h  Huhipl*  DiacipliM*.  Aiu}yt>e«l  Penwt 


Network-Centric  JEOD  Training,  Support,  and  Operations  enabled  by  the 

JEOD  Decision  Support  System 


Empowering  the  operational  JEOD  community  s  response  Teams  to  counter  threats.. 

—  EOD  Response  T earns - ^ — Threats - ^ 


CO 


r 

f  JEOD 
Portal 

Mobile  ^ 

Field  ] 

JEODNet 


...with  advanced  automated  tools  and  connectivity... 

-JEOD  Decision  Support  System- 


-JEOD  Portal- 


-JEODNET  Infrastructure 


-Mr^biie  Field  Kit- 


Secune  Wireless 
Communications 


Clients  with  GPS 


Server 


...to  the  training  and  support  communities 


<!*) 


Intelligence  Community, 
DoD  Sites,  and  other 
Government  Agencies 


Support  Community 


DoDAF  OV-1 
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Semantic  Web  Research  and 
Dynamic  Job  Aid  System  (DJAS) 

Demonstration 


Funded  by  DARPA 


i^RESEMCH  DARPA  -  Semantic  Web  Research 

CORPORATION 

'nuc«9h  Huhipl*  DiacipliM*.  Aiulyae*!  Penwt 

•  Member  of  DARPA  Agent  Markup  Language  (DAML) 
research  team 

-  Focus  on  military  applications  of  semantic  web  technology 

*  Leveraged  our  Training  &  Performance  Support  Business 
Solution 

-  Training/Task  Analysis 
-  High  Performance  Team  Training 
-  Interactive  Multimedia  Instruction 
-  Automated  Training  Management 

*  Developed  Dynamic  Job  Aid  System  (DJAS) 

-  Instantiated  the  system  with  Joint  Explosive  Ordnance 
Disposal  (JEOD)  related  content: 

•  Tactics,  Techniques,  and  Procedures  (TTPs) 
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*  Proof-of-principle  demonstration  for  filtering  and  formatting 
JEOD  TTPs  using  Semantic  Web  markup 

*  Goals 

-  Domain  agility 

-  Separation  of  content  from  format 
-  Context-based  filtering  (dynamic) 

-  Standard  representations  support  sharing  and  inferencing 

*  Demonstration 

-  Auto-author  procedural-based  instructional  information 

-  Content  contextualized  in  real-time 

-  Content  used  for  just-in-time  warfighter  training  while  in  the 
field 
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Dynamic  Job  Aid  System  (DJAS) 
Demonstration 
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•  The  Semantic  Web  is  the  new  evoiution  of  the  Worid 
Wide  Web  supported  by  ontoiogies. 

*  Ontoiogies  formaiiy  specify  concepts  and  their 
reiationships  to  other  concepts. 


-  When  classes,  subclasses,  and  relationships  among  entities 
expressed  in  an  ontology  are  defined,  they  provide  a  very 
powerful  medium  for  assisting  in  the  interpretation  of  the  data  by 
software  agents. 


-  Ontologies  can  be  encoded  using  the  Web  Ontology  Language 
(OWL)  which  received  W3C  Recommendation  Status  in  10 
February  2004. 

-  OWL  is  built  on  XML/RDF,  adding  structure  to  web  content  that 
is  required  to  support  automated  reasoning. 


*  A  set  of  related  ontologies  form  the  foundation  of  the 
semantic  web. 
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Applications 

^  Implementation  Layer 

Ontology  Languages  (OWL  Full, 
OWL  DL,  and  OWL  Lite) 

^  Logical  Layer 

RDF  Schema 

Individuals 

1  Ontological  Primitive 

1  Layer 

RDF  and  RDF/XML 

1  Basic  Relational 

1  Language  Layer 

XML  and  XML  Schema 

^  Transport/Syntax  Layer 

URIs  and  Namespaces 

^  Symbol/Reference  Layer 

Figure  ©  Lee  W.  Lacy  -  2005 
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Tactics  Techniques  Procedures  (TTP) 

Ontology  Design 
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Dynamic  Job  Aid  System  (DJAS) 
Concept  Diagram 
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DJAS  Web  Services 
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Filter  TTP 
XML 

Web  Service 


Filter  Web  Service 

-  Based  on  current  conditions 


Format  TTP 
XML 

Web  Service 


Format  Web  Service 

-  Based  on  form  factor  (e.g.,  handheld, 
tablet  PC)  and  desired  presentation 
method 
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DJAS  Filter  Web  Service 
Component  Interaction  Diagram 
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DJAS  Format  Web  Service 
Component  Interaction  Diagram 
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Client  Format  Request  with: 

•  Defined  RDF  TTP  URL 

•  Defined  Index 


(^Client  Format  Request  with: 

•  Defined  RDF  TTP  URL 

•  Defined  FormatType 

(4) Format  Web  Service  Response  Format  Web  Service  Response  with: 
with:  •  URL  for  XHTML  Hyperlinked 

•  URL  for  XHTML  Formatted  TTP  Indexes 


Page  19  of  44 


® 


DYNAMICS 

RESEARCH 

CORPORATION 


JEOD  KTOD  ACID 
Decision  Support  System  (DSS) 


Funded  by  JEOD  KTOD  ACTD 


DYNAMICS  Evolution  of  DJAS  to  JEOD  KTOD  ACTD 
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*  JEOD  Advanced  Concept  Technology  Demonstration 
(ACTD)  recognized  the  potentiai  of  DJAS 

*  JEOD  funded  DRC  to  evoive  DJAS  into  a  Reference 
Assistant  Tooi  (RAT)  and  to  aiso  deveiop  a  Content 
Authoring  Tooi  (CAT) 

*  RAT  is  part  of  the  Mobiie  Fieid  Kit  (MFK)  of  the  JEOD 
Decision  Support  System  (DSS)  whiie  CAT  supports  the 
content  authoring  in  the  Portai 

*  initiai  DJAS  TTP  Ontoiogy  evoived  to  a  suite  of  ontoiogies: 

-  Mission  Ontology 

-  Content  Ontology 

-  Condition  Ontology 
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•  Provide  contextualized  Just-In-Time  (JIT)  training  of  procedural 
content  to  warfighters  while  in  the  field. 
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Military  Learning  Solution 


*  Identified  “just  in  time”  instructionai  content  needed  by  EOD 
Techs 

*  Created  ontoiogy  suite  representing  instructionai  (Job  aid) 
materiai 

*  Deveioped  a  capture  tooi  as  part  of  the  JEOD  Portai  that 
aiiows  distributed  authors  to  create  hyperiinked  content  by 
popuiating  a  database  that  generated  RDF/XML  fiies 
compiiant  with  ontoiogy  suite 

*  Created  instructionai  component  of  the  JEOD  DSS  aiiowing 
iearners  to  retrieve  context-sensitive  (conditions  based) 
training  on-the-fiy  in  muitipie  formats 
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*  Content  identified  for  use  in  the  fieid  by  warfighters  are 
Tactics,  Techniques,  &  Procedures  (TTPs)  for  improvised 
Expiosive  Devices  (iEDs) 


*  The  TTPs  may  oniy  be  appiicabie  to  certain  Universai  Joint 
Task  List  (UJTL)  conditions  (ex:  weather,  terrain,  iight) 
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*  Developed  a  set  of  ontologies  to  capture  the  JEOD  lED 
domain 

*  Ontologies  developed  describe  Mission,  Content,  and 
Conditions 


*  Ontology  design  documentation  used  UML-like  notation 

*  Ontology  design  was  used  to  evolve  the  design  of  the 
database  used  in  the  authoring  of  content 
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•  Mission  Ontology  Classes 

-  Mission 

-  Sub-Mission 

-  Threat  Response  Category 

-  Phase 

-  Sub-Phase 
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Content  Ontology  Classes 

-  Task 

-  Step 

-  Content  Item 
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Ontology 
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Condition  Ontoiogy  Ciasses 

-  Condition 
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Content 


Authoring  Tool  (CAT) 
J2EE  Portlet 
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*  Developed  a  Content  Authoring  Tool  portlet  on  the  JEOD 
Portal  that  allowed  distributed  authors  to  create  TTP  content 

*  Authored  TTP  content  popuiated  an  Oracie  database  that 
generated  RDF/XML  files  compliant  with  the  JEOD  ontology 
suite 

*  Content  Authoring  Tool  (CAT)  allowed  authors  to  assign 
conditions  to  the  deveioped  content 
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Content  Authoring  Tool 
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Content  Authoring  Tool 
Add  Step  -  Conditions 
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Content  Authoring  Tool 
Add  Task  -  Steps 


MORSS 

us  Naval  Academy 
Annapolis.  Maryland 

Jane  12-13-14  2007 
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Content  Authoring  Tool 
Add  Task  -  Conditions 
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Reference  Assistant  Tool  (RAT) 
on  JEOD  DSS  Mobile  Field  Kit 


Funded  by  JEOD  KTOD  ACTD 
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Reference  Assistant  Tool 


*  Enables  the  warfighter  to  search  the  knowledge  base  for 
instructional  content 

*  The  search  results  are  filtered  based  on  system  conditions 

*  The  RAT  allows  the  user  to  retrieve  context-sensitive 
(condition  based)  training  formatted  on-the-fly  based  on  the 
users’  form  factor 

*  The  user  is  allowed  to  override  system  conditions  which 
triggers  a  real-time  re-authoring  of  the  training  materials 
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Reference  Assistant  Tool  (RAT)  Solution 
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*  Resides  on  Mobile  Field  Kit  (MFK) 

-  part  of  the  JEOD  Decision  Support  System  (DSS) 

-  installed  on  Tablet  PC  platform 

*  Searches  knowledge  base  for  instructional  content 
requested  by  warfighter  (mobile  user) 

-  speech  to  text  capability 

-  natural  language  processing  capability 

*  Filters  search  results  based  on  current  conditions 

-  MFK  can  receive  condition  updates  from  sensors 

*  Retrieves  context-sensitive  training  formatted  for  user’s 
form  factor  on-the-fly 

*  Triggers  immediate  re-authoring  of  the  training  materials 
based  on  user’s  decision  to  override  current  conditions 
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Reference  Assistant  Tool  (RAT) 
Demonstration 
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search  history 

User  ]s  abJe  to  move  back 
and  forth  through  search 
h  f  story. 

TTP  content 


Tactics,  Techniques^ 
and  Procedures  are 
available  for  searching. 

legacy  content 

More  supported  fori..^.^ 
for  searching:  XML,  HTML, 
XKTMLRDRPDF,  DOC 
XL5,  PPTJXT^RTF. 

leKken  terms 


Mobile  Field  Kit  -  Incident  #1 ;  User,  D 

0®® 

I  File  View  Plugiis  Ofitions  Help 

Terms  and  definitions  from 
the  default  EOD  fexicon 
avaiJabfe  for  searcJting. 


Iti): 


f7i 


(K 


-m 


Reference  Assistant  Tool  x 


Search  for: 


how  do  1  US0  a  romoto  adaptor) 


fP: 


All  Content 


[l5 


f  1Z3TTP  Content 

■  1 T  TSK 1 058557779264.rdf  TT?  c  □  ntB  nt 

Score  =9.0% 


3)  5TP 1 0Q 1 323255932-il4e52.r[lf  TTF  content 

■  51:0^0=5.0% 

9  Legacy  Content 

'  4T..antennasdata.p[tf . Legacy  content. 

Score  =3.0% 


2) . . .AntQnnas.pctf . La g a cv  contont. 

Score  =2.0% 

f  Lexicon  ContBnt 

'  adapter 

1 .  Mechanical.  Any  modifying  part,  piece,  or  device,  designed  to  facilitate  connecton,  provide  accornmodatian,  enable  applic 

2.  Electrical.  An  itemthat  providesthe  necessary  accommodationsto  electrically  connect  two  or  more  items  whose  design  g 
Synonyms:  [} 

Score  1  00.0% 

A 

1 .  in  sucn  usage  as  Ml  8A3,  designates  an  accepted  modlTlcatlon  or  a  standardized  Item. 

Synonyms:  [} 

.  Score  100.0% 


III 


Total  rosulte  roturnacJ:  6 
1  Search 


Display 


TTP  Conditions 


Preferences 


n-line  S2  / 138 


1^1  K 


:  attachments 


0^ 


^  Command:  - 


read  results 


Results  can  bt 
read  aloud. 
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Reference  Assistant  Tool  (RAT) 
Demonstration 


MORSS 

us  Naval  Academy 
Annapolis.  Maryland 

Jane  12-13-14  2007 
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navigation 

User  can  navigate 
through  content  similar 
to  web  browsers. 


browser 

Standard  browser  (IE  or 
Firefox)  is  embedded. 
This  allows  for  more 
types  of  content  to  be 
displayed  and  abides  by 
a  common  look  and 
feel  for  the  end  user. 


road 


Content  can 
be  read  aloud. 
Multiple  formats 
supported  (HTML, 
XML  XHTML  RDF, 
PDF.  RTF,  PPTJXT, 
andXLS). 
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Reference  Assistant  Tool  (RAT) 
Demonstration 


MORSS 

us  Naval  Academy 
Annapolis.  Maryland 

Jane  12-13-14  2007 


'nuc«9h  Huliipl*  DiacipliM*.  Aiulyae*!  Penwt 


conditions 


Conditions  can 
be  setin  general 
for  tactics, 
techniques,  and 
procedures  so 
that  all  content 
can  be  filtered 
appropriately. 


navigation 


U  ser  c  a  n  Ti  avig  ate  t h  ro  ug  h 
tactics,  techniques,  and 
procedures  similar  to 
web  browsers. 

TIP  content 


User  can  view  tactics, 
techniques,  and 
procedures. 


■ 


Mdbllf  FlerCd  Kit  -  Enc1d«tiE  #1 ;  User.  D 


FIb  Veiiv  Phi^s  OjJiDns 


FLefErcflcc  Assislant  IodI  k 


[£} 


'>tE] 


SUB  PHASE;  SuspOkj  ;PP:, 


TASK;  Plan  Eaey  R 0111019  Approach 
i~  = -nry^iriF;!' :ji^-iF!fal  liivir.  ^~il  -^~li^  h-^nrllinti 


Mahitc  FicEd  Kft  -  IncEdenC  ffl ;  Uier.  D 


EHe  View  EhQfKi  Qp\Jlions  Uettr 


1^- 

iQ 

12. 

a 

fl 


ReieEeiiceAE^cEianL  looi  : 


i:uRiTFifT  rrjHnmnNS 

NOTE:  ttiEse  cronditiQns  represent  1he  curreni  state  Conlent  ia  filtered  ha=ed  on  Itieae  cendH-ions  You 
may  CTi^rride  any  of  the  current  condhinna  by  apply  Ihs  desired  values  svith  I  he  'Submit'  button. 

Select  Weather 

r 

Suiui^ 

Select  Terrain  Type 
■f'  Rocky 

^  SiJidy 


Submit  I  F^eat  | 


1-To  cdIFiie  pinai.’t  JeEtc^d  ITtcd  Lc  ioc-p  tLrvugL  aiJ  '.usjpjKy  ti  pcsik-le  coi- Jidc-iji 

Saarch  J  EMspliiv  ,  TTPCnnriitiaiB  .  Ptuforancas  | 


pottditie 


#  ^  atlactmierits  1^ 


wa  1^0;  ll^commamlt- 


CURRENT  CONDITIONS 


HOTEtTnose  condilions  topte-sonl  EEio  cutr&nE  ttalo 
Content  is  fiilered  based  ori  these  conditions  You 
may  o-reitide  any  of  the  curront  coridiliona  by  apply 
rhs  desired  v, slues  'Mith  the  "Suhmtt"  Lu.itton 


Srlcct  WealRcr: 
i“  Rainy 
n  SiLtmy 


Select  Tertatfj'IVpe. 
^  Rocky 
^  Sandy 


Submit  I  Resel 


!  C  ;.u  JsErj:it . .  no ;  ncll  j 

I.  i 

iriffile:  fil-::i''C:i'jsod  ' 

! Ifj? s'rir 'itThRngit; n.''- oti:nr-j%.-TSpr  I  =.'i ■' 7 17 '1  TCt  '"df i 


CONTENT  FEEDB  ACK 


NOTE:  Plt-a-5H  rate  llie  ccinleriE  base  tin 
ijsgtullness. 


How  useful  was  the  content 
^  Very 

■"  So  3d 
Not  At  All 


Sub  mil  [[  Reset  [ 


ie.'R/ieod-  — 

s^st  at  ciiti^Lizi  eT  oiL^etL  yLEpTSBI  1 0  5  3537T''9  2d-1  .  c  'df; 


Seatch  [  Dbpkv  TTP  Conditioiis  |  PreTerences 


^DnJiia  psnas  |§  ^ anactinnnts  |4|  |  (1^^ 


^  l.^iCotiiifianit-1 


read 

Tactics, 

tech  niques,  and 
procedures  can  be 
read  aloud. 


conditions 

User  can  adjust 
current  conditions 
on-th e-fly  to  update 
tactics,  techniques, 
and  procedures  for 
environment. 


feedback 

Users  ca  n 
provide  feedback 
on  tactics,  techniques, 
and  procedures. 
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Summary 


•  Challenge 

-  Save  Warfighter  Lives 

-  Reduce  Cost  for  Procedural  Instructional  Content 

•  Context 

-  I EDs  constantly  evolving 

-  JEOD  ACTD  -  globally  deployable  DSS 

•  Military  Learning  Objective 

-  Provide  contextualized  JIT  training  to  warfighters  in  the  field 

•  Semantic  Web  Background 

-  Next  Evolution  of  the  Web  (OWL) 

-  Standards  Layers  allow  automation  based  on  content 

•  Military  Learning  Solution 

-  DJAS  as  a  prototype 

-  JEOD  DSS  design/development 
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